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SYSTEM FOR MEASURING LEADERSHIP a risk taker, and having a drive to excel. Additionally, a 

EFFECTIVENESS validation section having at least one statement directed 

toward verifiable performance of a business where the object 

TECHNICAL FIELD OF THE INVENTION is employed may be provided. 

The present invention relates generally to a method and 5 m accordance with one embodiment, the statements may 

system for measuring effectiveness of an object, and more of *PFC*imate equal length and each generally arranged 

particularly to a system for, and method of, measuring on a smgle Une. Moreover, me statements and the frequency 

leadership effectiveness of a manager. estirnation scales may be printed on a single form having a 

first side and a second side. 

BACKGROUND OF THE INVENTION 10 Important technical advantages of the present invention 

Competent management is generally recognized as essen- J 0 ^" !l mCasuriDg f 

tial to the success of a business. To obtakcompetent ^veness of a manager, or other types of 

management, businesses often employ performance a^prais- f^T^ ° f ** 

alc _7L_ in^^i n«»«^r^ n /tZZi n „ vides an assessment tool having good reliability in that its 

ds as an integral of ir^e^ l5 ^ rf reaction and having good validity 

pro^TVpically, an appraisal comprises a qucsUonnaire ^ ^£ ™« g00a ymQa * 
or other type of survey device for eliciting responses from 

the manager to be evaluated and from selected co-workers. Another important technical advantage of the present 

The survey may include a series of questions designed to invention includes providing an assessment tool that uses 

obtain responses suitable for developing data respecting the 20 ob j cctive means foT cvaluatin S managers or other objects, 

strength and weaknesses of the manager, in relation to Sdu another important technical advantage of the present 

management duties, and how the performance of the man- Mention is that it is gender-neutral and includes the ability 

ager is perceived by others. Frequently, the response data is to palliate a manager without introducing bias that could 

compiled for review by the manager as a feedback device, unfairly discriminate against a group, 

upon which to base corrective action, or otherwise inspire 25 Other technical advantages are readily apparent to one 

improvement skilled in the art from the following figures, description, and 

Existing evaluation tools, however, are largely ineffective claims, 

because they often yield results that are unreliable in that BRIEF DESCRIPTION OF THE DRAWINGS 

they are not capable of reproduction and that are invalid in ^^^^ 

that they are incorrect This is particularly problematic so For a more complete understanding of the present 

because federal law now requires mat any evaluation having invention, and the advantages thereof, reference is now 

an impact on employee promotion, demotion, assignment, made to the following description taken in conjunction with 

training, or job responsibilities, be able to prove its reliabil- the accompanying drawings, in which: 

ity and validity. Accordingly, there exists a need in the art far FIG. 1A-B is a face view of an assessment tool for 

an improved tool for evaluating the Leadership effectiveness 35 measuring leadership effectiveness of a manager in accor- 

of a manager. dance with the present invention; 

SUMMARY OF THE INVENTION . 2 U * schcmatic of a compter system 

for processing responses to me assessment tool of FIG. 1; 

In accordance with the present invention, a system and and 

method of evaluating leadership effectiveness of a manager, FIG. 3 is a flow chart of a method of measuring leadership 

or other types of effectiveness of an object, is provided mat effectiveness in accordance with the present invention, 
substantially eliminates or reduces the disadvantages and 

problems associated with prior evaluation tools. DETAILED DESCRIPTION OF THE 

In accordance with the present invention, an assessment 45 INVENTION 
tool for gathering meaningful information concerning an " The preferred embodiments of the present invention and 
object includes a plurality of statements directed toward its advantages are best understood by referring now to FIGS, 
observable characteristics of the object At least one state- 1 through 3 of the drawings, in which like numerals refer to 
ment is reverse keyed from the remaining statements. A like parts throughout the several views. FIG. 1 shows an 
frequency estimation scale corresponds to each statement jq assessment tool 12 for measuring the leadership effective- 
More specifically, the assessment tool may include a aess of a target manager. In this role, the assessment tool 12 
legend for the scale. The legend may include a low pole may be used either as a self-development tool, a staff 
having an infrequent label and a high pole having a frequent selection tool, or a combination of both. Those skilled in the 
label The infrequent label may be a never label and the art will understand that the assessment tool 12 may also be 
frequent label may be an always label. The legend may be 53 used to measure other types of effectiveness of other types 
prominently displayed a number of times. Moreover, the of objects. 

legend may include a plurality of unlabeled intermediate As shown in FIG. 1. the assessment tool 12 may include 

pol"- a plurality of sections 14 directed toward different behav- 

Additionally, the assessment tool may include a plurality ioral domains. In one embodiment, the assessment tool 12 

of sections directed toward different domains. Each section 60 includes sections directed toward the behavioral domains of 

includes at least one statement directed toward an observ- having personal convictions 2#. being visionary 22, building 

able characteristic of the object that is relevant to the emotional bonds 24, being inspirational 26. being team 

domain. A statement summarizing the characteristics of the oriented 28, being a risk taker If and having a drive to excel 

object relevant to the domain may also be provided for each 32. 

section. The sections may be directed toward the domains of 65 The personal conviction section 20 concerns the core set 

having personal convictions, being visionary, building erao- of values of a manager and how the manager lives his or her 

tional bonds, being inspirational* being team oriented, being life by them. Managers with strong personal convictions will 
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typically passionately communicate what they personally by respondents. Statements are preferred to questions 

stand for, and this personal conviction is a source of personal because statements are easier for respondents to conceptu- 

integrity. Their ethical compass directs their conduct and is alize. Typically, a respondent will read a statement, think of 

the basis for their confidence, creating a solid foundation for an example of the characteristic to which the statement is 
risks and growth. 5 dirccted > md ±cn compare the target manager with then 

The visionary section P^™^.^J^^^* Tfrlquency estimation scale 42 corresponds to each 
view of the future by quickly assimilating new intomauon. statein ^ 40. Frequency estimation scales 42 are preferred 
concepts, and ideas. Visionary managers are observant, tQ ^ attribudo ^ su ^ as having a respondent rate the 
seeing connections in widely disparate events. They selec- honesty ^ ft from a of good to Da d. The 
lively eliminate extraneous information, extrapolate from io frequency estimation scale 42 asks the respondent to check 
trends, and choose the correct direction. They are able to mcmor y & t o how many times they recall the occur- 
effectively deal with abstraction, uncertainty, and ambiguity. fCnce ^ ^ characteristic to which the statement 40 is 
With strong conviction, they take the necessary risk to directed Accordingly, respondents typically take care to 
pursue their vision. search their memory to determine the frequency of the 

The emotional bonds section 24 concerns a manager 15 characteristic being inquired about, and estimate that fre- 

establishing emotional bonds with individuals and the team. quency. 

Strong bonds are built by caring about team members and To prevent or greatly reduced response bias, the assess- 
their work. Managers with emotional bonds to their team meat tool 12 may employ a number of measures in addition 
create an environment where people eagerly look forward to to the use of statements 40 and the corresponding frequency 
coming to work and eliminate fear and intimidation from the 20 estimation scales 42. The frequency estimation scale 42 may 
work environment Such managers show respect for others include a neutral pole 43. The neutral pole 43 is achieved by 
and demonstrate openness, honesty, and fairness in dealing employing a scale having an odd number of selections such 
with others. that the middle selection is neutral. Thus, a respondent can 
The inspirational section 26 concerns managers that moti- rate the target manager as neutral which is Qeithex good no- 
vate the team to a higher level of excellence and bad 

achievement, while expanding each individual's comfort The frequency estimation scale 42 may also include a 

level. They foster initiative, innovation, creativity, risk non-response option 45. The non-response option 45 allows 

taking, and responsibility, resulting in team members— and respondents to honestly respond to statements to which they 

the team as a whole— achieving goals that stretch each do not have enough information or experience to judge the 

member's capability. They serve as strong, positive role target manager. Tlius, the non-response option prevents 

models, and they inspire through personal example. respondents from guessing at characteristics of a target 

The team oriented section 28 concerns managers that manager that they have not observed 

recognize that a team achieves more than individuals. Such The assessment tool 12 may include a legend 44 for the 
managers help people integrate and leverage individual „ scale 42, The legend 44 may include a low pole 46 and a 

contributions so that they function as a unified team. They high pole 48. Because the scale 42 is a frequency estimation 

leverage capabilities throughout the company by openly scale, the low pole 46 should have an infrequent label 50 and 

sharing the resources of their team. They adopt the best the high pole 48 should have a frequent label 52. As shown 

practices of other teams. in FIG. i. the infrequent label 50 may be a "never" label and 

The risk taker section 30 concerns managers who under- ^ the frequent label 52 may be an "always" labeL 

stand that gain can only be achieved with a commensurate The infrequent label 50 may include an end 54 disposed 

level of necessary risk. They naturally accept the risks directly above the low pole 46. Similarly, the frequent label 

associated with reaching their vision. Such managers take 52 may include an end 56 disposed directly above the high 

personal risks in support of their personal convictions and pole 48. As shown in FIG. 1, the last letter of the infrequent 

have the courage to pursue their vision even in adverse 45 label 50 may form the end 54 disposed directly above the 

situations. They try new ideas and accept uncertainty. They low pole 46. The first letter of the frequent label 52 may 

accept the risk and discomfort associated with change and form the end 56 disposed directly above the high pole 48. 

seek challenges that others would not seek. This alignment of the labels ensures that the full range of 

The drive.to excel section 32 concerns inanagers who options is seen by the respondent when the legend 44 is 

seek to iiMrove^therrielves, their team, and the company. 50 scanned Viewing of the full range encourages the respon- 

Such managers exhibit a great deal of energy, enthusiasm. dent to use the full range of the frequency estimation scale 

drive, determination, and tenacity. They seek responsibility 42. 

and accountability. They constantly seek opportunities to Respondents may also be encouraged to use the full range 

make a greater contribution and impact. They rise to the of the frequency estimation scale 42 by prominently dii- 

challeage. 55 playing the legend 44 on the assessment tool 12. 

Those skilled in the art will understand that the assess- Additionally, a plurality of legends 44 may be displayed at 
meat tool 12 may include all or only some of the above listed different locations of the assessment tool 12. The repeated 
behavioral domains, as well as other behavioral domains. display of the legend 44 reminds respondents of the avail- 
Thus, the assessment tool 12 may be adapted to the specific able options and encourages the use of the full range of the 
behavioral domains that are important to a particular busi- 60 scalc - 

ness. Moreover, completely different behavioral domains Preferably, the intermediate poles of the scale 42 are not 
may be used to measure the effectiveness of other types of labeled This allows respondents in different regions to 
object interpret the scale 42 in a similar way. Labeling the inter- 
Each section 14 may include a plurality of statements 40 mediate poles with terms such as -Very" distorts the results 
directed toward observable characteristics of the manager. 63 because the meaning of such terms vary in different regions. 
Thus, the statements 40 are not directed toward thoughts or Response bias can also be reduced by reverse keying one 
feelings that are internal and cannot be accurately measured or mere statements 40. In such a case, the high pole 48 is 
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sometimes associated with a favorable response and some- variations over time. Thus, the report allows top level 

times associated with an unfavorable response. Similarly, management to ascertain whether certain new programs 

the low pole 46 is sometimes associated with an unfavorable introduced to increase leadership effectiveness are having 

response and sometimes associated with a favorable the desired effect. 

response. Reverse keying prevents or reduces automatic 5 The assessment tool 12 may be presented in any suitable 

responses and thus yields more accurate responses. medium of expression. For example, the assessment tool 12 

As shown by FIG. 1. the statements 40 may be of electronically displayed on a computer monitor or 

approximately equal length and each generally arranged on otncr of CKr ^ke. Further, as shown by FIG. t the 

a single line. Thus, the statements 40 are short crisp, and asscssmcn A toc ! 1 n P** J* ^splayed in printed format Id 

direct. As a result respondents will understand at a glance 10 many applications, it will be desired to display the assess- 

that the assessment tool 12 is not unreasonably long andwfll m f? 1001 12 * P rmted fo ™ 50 that it can be used with 

not rush to finish. Accordingly, better results L 2ZS^ m f nUm e « m ^ nt > a **** 

the compact and simple format of the assessment tool 12 * on ! embodimc ° t me assessment tool 12 may be 

u»- --f displayed on a computer-readable printed form 72. In this 

The assessment tool 12 may include a number of valida- embodiment respondents typically use a No. 2 type pencil 

uon measures. A summary statement 60 may be used at the 15 such mat responses may be accurately read by a computer, 

end of each section to provide a direct method of testing Such computer-readable forms are well known in the art and 

reliability. The summary statement 60 summarizes the will not be further described. 

behavioral domain of the section 14. Reliability of the nG. 2 shows a geueral purpose computer system 80 for 

statements 40 of the section 14 are shown by good corre- receiving the assessment tool 12 and maiiipulating the 

lation between a response to the summary statement 60 and 20 responses thereon. The computer system 80 comprises a 

the responses to the other statements in the section 14. central processing unit (CPU) 82 that operates the computer 

The assessment tool 12 may also include a validation system in conjunction with an operating system 84 to 

section 62. The validation section 62 may include one or retrieve, process, store, and display data, 

more objective and verifiable statements 64. Accordingly, The CPU 82 is typically implemented as a microprocessor 

the accuracy of a response, and thus a respondent, may be such as that manufactured by Apple Computer or by Intel 

detennined from the validation section 62. The validation Corporation. The CPU 82 communicates control address, 

section 62 and the summary statement 60 of each section 14 and other signals with the operating system 84 and with the 

provide the assessment tool 12 with the reliability and remaining components of the computer system 80 through a 

validity required by federal law for any assessment having system bus. According to a specific errabodiment of the 

impact on employee promotion, demotion, assignment, present invention, the computer system 80 may be an 

training, or job responsibilities. "INTEL" platform manufactured by Compaq Computer. 

Validation of the different sections 14 also allows top The operating system 84 comprises a set of computer 

management to ascertain which behavioral domains are programs that control the internal functions of the computer 

most important to me business. This r^rmits the assessment 35 system 80, thereby allowing the computer system to run 

tool 12 to be revised over time to delete less meaningful application software. The operating system 84 is typically 

domains, to add more meaningful domains or to reflect installed in a mass storage device, such as a hard disk drive, 

changes in the corporate culture of the business. a floppy disk drive, a CD disk drive, or a ROM chip. During 

The assessment tool 12 may comprise a respondent sec- boot-up (initialization), the computer system 80, the oper- 

tion 70 for recording the relationship between the respon- ^ ating system 84 is loaded into system memory 85. 

dent and the target manager. As shown by FIG. 1, the A basic input/output system (BIOS) driver 86 is stored in 

respondent section 70 may include the categories of self, system memory 85 along with the operating system 84. The 

leader, peer/customer, and direct report. Preferably, the BIOS driver 86 supplies device-level control and support 

respondent sample composition includes a self evaluation, services for primary input/output devices of the computer 80 

an evaluation by a leader, and three or more evaluations by 4$ during the boot process. After a boot, the BIOS driver 86 

both peer/customers and direct reports. accepts requests from application programs and from the 

The self category is used by the target manager. The operating system 84 running on the computer system 80 and 
leader category is used by the supervisor of the target performs Input/output services as requested by those pro- 
manager. The peer/customer category is used by both peers grams. The functions and operations of conventional BIOS 
and customers of the target manager. The direct report 50 drivers are well known and will not be further described, 
category is used by employees who are supervised by the a scanner 88 for receiving a printed assessment tool 12 
target manager. may be provided. The scanner 88 may scan a printed form 

To preserve the validity of the responses, respondents in of the assessment too) 12 and store the responses into a 

the peer/customer and direct report categories should be designated file in system memory 85. As described below in 

anonymous. This allows such respondents to respond hon- 55 detail, the responses may be manipulated to generate an 

estly without fear of repercussions. To ensure autonomy of output report 90. A database 94 may be connected to the 

the peer/customer and the direct report respondents, each computer system 80 for use in connection with manipulating 

group should include a minimum of three respondents. the responses. The output report 90 may be printed via a 

The results obtained from the assessment tool 12 may be standard printer 92. Scanners, databases and printers are 

kept confidential, only being released back to the target 60 well known in the art and will not be further described, 

manager and to a reviewing supervisor. However, if desired. The method of the present invention for evaluating lead- 

a top level management report may be released to top level ership effectiveness of a manager will now be described, 

management At such a level, no specifics of any target Although the method of the present invention is described in 

manager are typically given. Instead, the report allows top terms of measuring the leadership effectiveness of a 

level management to discern in which areas their managers 65 manager, those skilled in the art will understand that the 

generally excel and in which areas they generally do poorly. present invention encompasses measuring the effectiveness 

The report also allows top level management to discern of other types of objects. 
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As sbowo in FIG. 3. the method begins at step 100 by can be graphically and/or numerically displayed Thus, the 
gathering responses with the assessment tool 12. As above target manager can easily determine how close his or her 

conrouter-readable media. For example, the responses may ™£ ' 

be gathered via a computer input device such as a keyboard, standard deviation. 

I IT ~ lit* io From the foregoing description of the present invention, 

mouse, touch screen, or the like. 10 o ^^ v / TOn ^Xma y suggest themselves to 

Next, at step 102, the responses may be validated. As Therefore, the scope of the present 

described above, responses may be vaHdated by summary ^ ^ claims ^ ^ mc 

questions 60 for sections of the assessment tool 12 and by ±mof 

the vahdauon section 62 directed toward verifiable perfor- is daime d is- 

raance of the business in which the manager is employed. i. An assessment tool for gathering meaningful informa- 

Proceeding to step 104, the responses may be manipulated Uon ^ncerning ^ object, comprising: 

to ascertain the leadership effectiveness of the manager. At ^ plurality of statements directed toward observable char- 

(his step, responses that cannot be validated may. if desired, acterisucs of said object; 

be ignored. Responses for which the statements 40 were ^ & fr cstim ati on scale corresponding to each 

reverse keyed are reversed such that favorable responses s ^ mcntt the frequency estimation scale comprising a 

bow lend towtrflbelii^ non-response option; and 

now tend toward the low ^^^^^3 at least oVe statement being reverse keyed from the 

response selections 45 may be treated as neutral pole 43 rcmaining statements. 

responses. 25 2. The assessment tool of claim 1. further comprising said 

Next, at step 106, the manipulated responses may be a ^ a mmgjBtm 

compared to a set of standardized responses of a business. In 3 ^ ^55^^ tool of claim 1, the scale further 

one embodiment, the set of standardized responses may be comprismg a ncutra i pole. 

a company average of previous responses. The responses ot 4 ^ asscssmcnt tool of claim 1, further comprising a 

the target manager, or the self-respondent, may be excluded ^ j for me sca j e< fa c legend including a low pole having 

from responses compared to the set of standardized ^ infrequent label and a high pole having a frequent labeL 

responses. Thus, the target manager cannot use his or her g Thc assessment tool of claim 4, further comprising the 

responses to raise his or her performance. Rather, the target ^^^^ being a never label and the frequent label 

manager's responses may be compared with the responses of ^ an always label. 

other respondents to deterniine the ability of the target to 3 5 ^ ^ ^g^^gm too i 0 f claim 4, the legend further 

realistically determine his or her performance. comprising a plurality of un-labeled intermediate poles. 

At step 10S, non-standard behavioral domains and char- 7 jh e assessment tool of claim 1, further comprising a 

acteristics may be identified. In one embodiment, non- legend for the scale being displayed prominently, 

standard domains and characteristics are those in which the g Tn e assessment tool of claim 1, further comprising the 
difference between a target manager's responses and the set 40 statements being of approximate equal length and each 

of standardized responses is statistically significant A dif- generally arranged on a single line, 

fere nee may be statistically significant where the respondent 9 jh e assessment tool of claim 1. wherein the statements 

average is one standard deviation or more above or below and mc frequency estimation scales are printed as a form, 

the company average. 10. The assessment tool of claim 1, further comprising 

One standard deviation or more above the company 45 sa id characteristics being leadership behavioral characteris- 

average places the manager's performance in the top tics. 

seventy-fifth percentile or above, meaning that seventy-five 11. The assessment tool of claim 1, further comprising: 

percent of all other assessed managers have a score below a plurality of sections each directed toward a different 

that of the target. In such a case, the characteristic or domain; and 

behavioral domain may be considered, with considerable 50 scct i on including at least one statement directed 

confidence, to be a relative strength. toward a directly observable characteristic of said 

One standard deviation or more below the company object relevant to the respective domain, 

average places the respondent's performance in the bottom 12. The assessment tool of claim U, the section further 

twenty-fifth percentile or below, meaning that seventy-five comprising a statement summarizing the characteristics of 
percent of all other assessed managers have a score above 55 8aid ob j^ rc ievant to the domain, 

that of the respondent In such a case, the behavioral domain 13. The assessment tool of claim 1, further comprising a 

or characteristic of the target manager can, with considerable validation section having at least one statement directed 

confidence, be considered a relative weakness. toward verifiable performance of a business where said 

The results may be printed in the form of the output report object is employed. 

90 .Tone embodiment the output report 90 includes a « 14. The assessment ^^/J^^^S a 

summary of the responses for each section 14 representing respondent section for recording the relationship between a 

a behavioral domain and for each statement 40 representing respondent and said object, 
a characteristic For each section 14 or statement 40, the 

target manager's self responses and the respondent average * * * * * 
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